Configuring large-scale storage using a middleware with machine learning

نویسندگان

  • David M. Eyers
  • Ramani Routray
  • Rui Zhang
  • Douglas Willcocks
  • Peter R. Pietzuch
چکیده

ions utilized over configuration parameters Each deployment of the SAN configuration middleware will see a different underlying SAN infrastructure (i.e. the myriad different data centres of different cloud providers), each with its own custom set of configuration parameters. Transporting these data to and from the best practice repository will require the use of an abstract data format for SAN configuration snapshots. We translate the heterogeneous SAN configuration parameters into a common representation. One important side effect of the mapping functions defined to do this translation is the removal of parameter values that might disclose confidential information about the environment of particular clients. The best practice repository stores data in an object-oriented, hierarchical format that extends the CIM/SMI-S profiles. For further details, see the DMTF Common Information Model specification [22], and the SNIA Storage Management Initiative Specification [23]. These profiles are defined by standard bodies that include most of the significant industry participants. All snapshots are tagged with timestamps and collect information about the open or unresolved problem tickets that have been raised in that particular data centre. The problem tickets also require translation into a standard format. In this case, particular classifications are required to be applied by the user raising Copyright 2011 John Wiley & Sons, Ltd. Concurrency Computat.: Pract. Exper. (2011)

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Access control in ultra-large-scale systems using a data-centric middleware

  The primary characteristic of an Ultra-Large-Scale (ULS) system is ultra-large size on any related dimension. A ULS system is generally considered as a system-of-systems with heterogeneous nodes and autonomous domains. As the size of a system-of-systems grows, and interoperability demand between sub-systems is increased, achieving more scalable and dynamic access control system becomes an im...

متن کامل

Using Machine Learning to Maintain QoS for Large-scale Publish/Subscribe Systems in Dynamic Environments

Quality-of-service (QoS)-enabled publish/subscribe (pub/sub) middleware provides powerful support for large-scale data dissemination. It is hard, however, to maintain specified QoS properties (such as reliability and latency) in dynamic environments (such as disaster relief operations or power grids). For example, managing QoS manually is not feasible in largescale dynamic systems due to (1) sl...

متن کامل

New System Architecture for Next-Generation Green Data Centers: Mangrove

With the aim of configuring next-generation green data centers, we introduce a new system architecture called “Mangrove” that achieves total optimization by vertically integrating servers, storage drives, networks, middleware, and facilities. Mangrove embodies resource pooling and the offloading of control functions to middleware, which are key concepts of the Next-Generation Green Data Center....

متن کامل

TF.Learn: TensorFlow's High-level Module for Distributed Machine Learning

TF.Learn is a high-level Python module for distributed machine learning inside TensorFlow (Abadi et al., 2015). It provides an easy-to-use Scikit-learn (Pedregosa et al., 2011) style interface to simplify the process of creating, configuring, training, evaluating, and experimenting a machine learning model. TF.Learn integrates a wide range of state-ofart machine learning algorithms built on top...

متن کامل

Machine Learning and Citizen Science: Opportunities and Challenges of Human-Computer Interaction

Background and Aim: In processing large data, scientists have to perform the tedious task of analyzing hefty bulk of data. Machine learning techniques are a potential solution to this problem. In citizen science, human and artificial intelligence may be unified to facilitate this effort. Considering the ambiguities in machine performance and management of user-generated data, this paper aims to...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Concurrency and Computation: Practice and Experience

دوره 23  شماره 

صفحات  -

تاریخ انتشار 2011